Papers with learning of student models
Domain-Aware k-Nearest-Neighbor Knowledge Distillation for Machine Translation (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to transfer knowledge from kNN datastore into new models are expensive and arbitrarily transfer knowledge. |
| Approach: | They propose a domain-aware method which filters out domain-relevant neighborhood knowledge for learning in the distillation process. |
| Outcome: | The proposed method achieves state-of-the-art on four domain translation tasks. |